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Hopf bifurcation in a general n-neuron 
ring network with n time delays 


E. Javidmanesh and M. Khorshidi* 


Abstract 


In this paper, we consider a general ring network consisting of n neurons 
and n time delays. By analyzing the associated characteristic equation, a 
classification according to n is presented. It is investigated that Hopf bifur- 
cation occurs when the sum of the n delays passes through a critical value. 
In fact, a family of periodic solutions bifurcate from the origin, while the 
zero solution loses its asymptotically stability. To illustrate our theoretical 
results, numerical simulation is given. 
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Time delay. 


1 Introduction 


Since Hopfield constructed a simplified neural network (NN) model [7, 15], 
the dynamic behaviors (such as stability, periodic oscillatory, limit cycles, bi- 
furcation and chaos) of continuous-time neural networks have received much 
attention due to their applications in optimization, signal processing, image 
processing, solving nonlinear algebraic equations, pattern recognition, asso- 
ciative memories and so on (see, [8, 10, 11, 18] and references therein). It 
is well known that time delays exist in the signal transmission, thus Marcus 
and Westervelt proposed an NN model with delays, based on the Hopfield 
NN model [12]. The time delays are regarded as parameters; consequently, 
periodic solutions often appear as solutions of delay differential equations 
(DDEs) through Hopf bifurcation. For example, existence of periodic solu- 
tions, in a special type of DDEs, has been discussed in [9]. In [8, 16, 17], the 
authors used Hopf bifurcation theory to study some kinds of neural networks. 
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A ring network is a network topology in which each node connects to 
exactly two other nodes, forming a single continuous pathway for signals 
through each node a ring. Data travel from node to node, with each node 
along the way handling every packet. 


Ring networks have been found in a variety of neural structures such as 
cerebellum [5], and even in chemistry and electrical engineering. In the field 
of neural networks, rings are studied to gain insight into the mechanisms 
underlying the behavior of recurrent networks. In [16], Wang and Han inves- 
tigated the continuous-time bidirectional ring network model. Many results 
have been reported in the literature on the dynamics of ring neural networks 
(see [2, 18]). The local and global stability of ring networks with delays have 
been discussed in [2, 18]. In [1], stability analysis of a delayed ring network 
model has been discussed. 


In this paper, we study Hopf bifurcation for a kind of DDE system. In 
fact, we consider a general ring network with n neurons and n time delays, 
which is described by the following DDE system: 


&1(t) = —riai(t) + 9 (xi(t)) + filan(t — T)), 
&2(t) = —rero(t) + go(xa(t)) + fo(ai(t — 71), 
£3(t) = —r3x3(t) + g3(r3(t)) + fa(ra(t — 72)), 


tn—1i(E) = —Tn-1%n—1(t) + Gn—1(L@n—-1(t)) + fn—-1(@n-2(t _ T—2))s 
Ly (t) = Fatt) 7 Gn(2n(t)) + Fata ailt _ Tat) 


where r; > 0 (¢ = 1, 2,...,n) denotes the stability of internal neuron processes, 
and «;(t) (i = 1,2,...,n) represents the state of the ith neuron at time t. fi; 
and g; (i = 1,2,...,n) are the activation function and nonlinear feedback 
function, respectively. Also, 7; > 0 (¢ = 1,2,...n) describes the synaptic 
transmission delay. Figure 1 shows system (1) schematically. 


Figure 1: A general n-neuron ring with n delays 
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The properties of periodic solutions are also important in many applica- 
tions. In fact, various local periodic solutions can arise from the different 
equilibrium points of ring networks by applying Hopf bifurcation technique, 
therefore the study of Hopf bifurcation is very important. In [16], the sim- 
plified three-neuron bidirectional ring network has been investigated. Four- 
neuron and five-neuron networks with multiple delays have been studied in 
[8, 17]. 

In this paper, we discuss Hopf bifurcation on system (1) generally, not for 
a particular n. To the best of our knowledge, it has not been done before. We 
would like to point out that in [1], although stability analysis of the system 
has been presented, but the authors didn’t discuss Hopf bifurcation on the 
system in all cases. First, we take the sum of the delays 7, +72+...+7, asa 
parameter T. By classifying based on n, we study the associated characteristic 
equation. To calculate the critical value 7) for Hopf bifurcation, we generalize 
and modify the methods proposed in [8, 9]. Then we will show that the zero 
solution loses its stability and Hopf bifurcation occurs when 7 passes through 
the critical value 7). We would like to point out that it is the first time to 
deal with Hopf bifurcation analysis of system (1). This paper is organized 
in five sections. In Sect.2, we give the necessary preliminaries. In Sect.3, 
we will study Hopf bifurcation on system (1). To illustrate the results, some 
numerical simulations are presented in Sect.4. Finally, in Sect.5, some main 
conclusions are stated. 


2 Preliminaries 


2.1 Delay Differential Equation 


There is always a time delay in many natural phenomena, because a finite 
time is required to sense information and then react to it. DDEs are dif- 
ferential equations in which the derivatives of some unknown functions at 
present time are dependent on the values of the functions at previous times. 
A general delay differential equation for x(t) € R” takes the form 


a(t) = f(t, x(t), a2), (2) 


where x;(0) = a(t + 0) and —r < 0 < 0. Observe that 2,(0) with —7r < 
# < 0 represents a portion of the solution trajectory in a recent past. In this 
equation f is a functional operator from R x R® x C!(R,R”) to R®. Similar 
to ODEs, many properties of linear DDEs can be characterized and analyzed 
using the characteristic equation. 

The linearization of system (2) at the equilibrium point Zo is 


&(t) = Apx(t) + Ara(t — 71) +++» + Ama(t — Tm), (3) 
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where A; = Dj41f(xo,...,%0), (7 =0,1,...,m) and D;f is the Jacobian of f 
corresponding to its jth component. 
Substitude x(t) = e**v, v € R” into (3), we have 


[AI — Ao — S- Aje > Jeu = 0. 


j=l 


Therefore the characteristic equation associated with (2) is 


det(\I — Ay — §~ Aye’) = 0. (4) 


j=1 


For further details, see [4]. 


2.2 Hopf bifurcation 


In this section, we study bifurcations that occur in C! system 


&= f(z, 1), (5) 


depending on a parameter pp € R, at nonhyperbolic equilibrium points. In 
the following, we will give definition of a structurally stable vector field or 
dynamical system. 


Definition 2.1. Let E be an open subset of R®. A vector field f € Cl(E) is 
said to be structurally stable if there is an € > 0 such that for all g € C!(E) 
with || f — g|| < ¢, f and g are topologically equivalent on E; i.e., there is 
a homeomorphism H : E > E which maps trajectories of = f(x) onto 
trajectories of & = g(x), and preserves their orientation by time. In this 
case, we also say that the dynamical system « = f(x) ts structurally stable. 
If a vector field f € Cl(E) is not structurally stable, then f is said to be 
structurally unstable. 


The qualitative behavior of the solution set of system (5) depending on 
a parameter ys € R, changes as the vector field f passes through a point in 
the bifurcation set or as the parameter varies through a bifurcation value 
io. A value pio of the parameter ys in equation (5) for which the C+ vector 
field f(a, j19) is not structurally stable is called a bifurcation value. For more 
information see [13]. 


Theorem 2.2. Suppose that system (5), has an equilibrium (x, fo) at which 
the following properties are satisfied: 


a: Dzfuo(to) has a simple pair of pure imaginary eigenvalues and other 
eigenvalues have negative real parts. Therefore, there exist a smooth 
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curve of equilibria (x(u),u) with x(uo) = xo. The eigenvalues X(t), 
Ae) of De fuo(a(e)) which are imaginary at wp = po vary smoothly 
with p. 


Furthermore, tf, 


bi: FRM) =d40, 


then Hopf bifurcation will occur. 


Proof. see [6]. 

When the parameter js passes through the critical value fio, according 
theorem 2.2, Hopf bifurcation occurs. In fact, a family of periodic solutions 
appear or disappear. If the equilibrium point is asymptotically stable for 
LL < po, when p passes through jug, a family periodic solutions bifurcate from 
the equilibrium point. In this case, we say that supercritical Hopf bifurcation 
occurs. But, if a branch of periodic solutions exist for uw < pio and while yu 
passes through po, these periodic solutions disappear, we say that subcritical 
Hopf bifurcation happens. For more details, see [6]. 


3 Main results 
To establish the main results for system (1), it is necessary to make the 
following assumption 

figve Cy F(O= 9:0) =0, ford $1, 2,37 (6) 


It is easily seen that the origin (0,0,...,0) is an equilibrium point of (1). Under 
the hypothesis (6), the linearization of (1) around the origin gives 


41 (t) = —kyx 1 (t) + fi(O)an(t =Ta); 
£(t) = —kx2(t) + f.(0)ai(t — 71), 


tn—1(t) = —ky—12n—-1(t) a i, Oaegoalt ae Tr—2)s 
En(t) = —kntn(t) + f,(0)@n—1(t — Tm-1), 
where k; =r; — g,(0), i=1,2,...,n. The characteristic equation of (2) is 


XN” yA") 4 + Gp A ton + be = 0, (8) 


where 
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n 
=> hi. GS YY) ky <<; 
i=l 1<i<j<n 


Qn-1= S- kikjky..-kmny 
1i<g<l<..<m<n 
ea 


n-1 
an=[[k, b=-]] 0, 7= don. (9) 
i=1 i=1 
Denote 
p(dA) = A” + ad? + api A + Gn, 
then equation (8) becomes 
p(d) + be~*7 = 0. (10) 


To study Hopf bifurcation, it is necessary to discuss the existence of pure 
imaginary roots of (10). Letting \ = iw, and substituting this into (10), we 
have 

A+iB + b(coswr — isinwr) = 0, 11) 


where 
A= Re{p(iw)}, B= Im{p(iw)}. 12) 


Separating the real and imaginary parts of (11), we get 
A+ beoswt = 0, 13) 


and 


B— bsinwt = 0. 14) 
We rewrite the equations (13) and (14), as follows: 


A = —bcoswrT, 15) 


and 


B = bsinwr. 16) 
Squaring both sides of (15) and (16), and adding them up gives 
A’ + B® =0?. (17) 


Now, according to (12), it is easy to use computer to calculate the roots of 
(17). Then we can get the time delay 7, by substituting w in (15). 
To find the solutions for equation (17), we consider the following cases: 


Case (a) : n=4k (k EN), 


Case (b) : n=4k+1(kK EN), 
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Case (c) : n= 4k +2 (k © NU {0}), 


Case (d) : n=4k +3 (k € NU {0}), 


In case (a), from (12) and the definition of p(X), we can get 


A => w”™ = aguw”™—? + agw”—4 He SF an, (18) 
B= —ayw"! + agw”3 — agw > +... + dn_iw. 
Using (17) and (18), we obtain 
(w” aqu” 2 +aqw"—*—...4 an)? + (—ayw” 14 agw"3 — agw™ 5 +... 4 an—1w)? = 0b". 
(19) 
In case (b), the definition of p(A) and (12) lead to 
A = ayw"—1 — agw"—3 + agw”> — ... + an, (20) 
B=w"” — aqw”? + agw”* — 0. + dni. 
Substituting (20) in (17) gives 
(ayw” 1_ggw"3 ta5w" > -...4 an)? E(w” aow” 2 +a4w"4—...4 an—1w)? =p’, (21) 
In case (c), A and B can be calculated as follows: 
A= —w" + agw”~? — agw”* +... + Gn, (22) 
B= ayw"! — agw”™3 + agw”—5 — ... + dn_iw. 
From the equations (17) and (22), we have 
(—w" + agqw”~? — agw"—4 4... +a)? + (aw 1 — agw" 3 +agw"> + On—1w)? = b?. 
(23) 
In case (d), from the definition of p(A) and (12), we can compute 
A= —ayw"! + agw"—3 — agw > +... + an, (24) 
B= —w"™ + agqw”—? — agw™—4* +... + Gn_iw. 
By using the equations (17) and (24), we can get 
(-aiw”™ Th agw"—3 —agw" 5 +...4 an)? + (—w" 4 aqw” 2 —agw"—*4...4 an—1w)? =b?, 
(25) 


In all the above cases, after simplification, we can easily see that the equa- 
tions (19), (21), (23) and (25) lead to 


gee ear ee Fe ae te, = 0, (26) 


where the coefficients e; (i = 1, 2,...,n), can be calculated as follows: 
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2 2 2 2 2 
€1 = aj — 2dg, e2 = a5 — 20143, +++ 5 Cn—-1 = A,_1 — 2GnGn_2, Cn = a7, — D*. 


(27) 
Letting z = w?, then equation (26) becomes 
7 beet t+ egz™ 2 +. 4 en_iz ten =0. (28) 


Thus, the fact that equation (28) has positive roots is a necessary condi- 
tion for the existence of the pure imaginary roots of equation (8). 
Let 
A(z) = 2" tea" 1 + coz" 7 4+ pepe ten: (29) 


In the following, we will give lemma to establish the distribution of posi- 
tive real roots of equation (28). 


Lemma 3.1. If en <0, then equation (12) has at least one positive root. 


Proof. Since h(0) = e, < 0 and lim,_,..h(z) = +00. Hence, there exists a 
zo > 0 such that h(zo) = 0. 


Now, from (15) we get 


1 -1/;-A - «¢ B 
(i) ag OO ae AIT) EO ie ae ey a 30 
Tk { 1 (2m — cos-1(=4) + 25m) if B <0 ODE lntie ee) 


where wp = \/2;, and without loss of generality, z{ (kK = 1,...,n) are the 
positive roots of (28). Therefore, we can define 


To =T, = __,min fe Wo = Who: (31) 


So, with the help of relations (17) and (31), wo and 79 are obtained. Now, 
we show that system (1) undergoes Hopf bifurcation at the origin when tT = 
yoy_1 Ti passes through 79. In all cases, the stability and Hopf bifurcation 
can be analyzed analogously. 
Let 

A(T) = a(t) + iw(r), (32) 
be the root of equation (8) near T = 7 satisfying a(r”) =0, w(7) = Wr. 
Then, the following lemma holds. 


Lemma 3.2. Suppose h'(z%) £0, where h(z) is defined by (4) and z% = w?. 
Then +iu, is a pair of simple purely imaginary roots of equation (3) when 
(3) 


T=T,°. Moreover, 


dRe(X(r)) 
dt 


Proof. From (17) and (12), equation (26) can be transformed into the follow- 
ing form 


| aaate) # 0. 
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p(iw)p(iw) — b? = 0. (33) 
From (29), we have = 
h(w*) = pliw)plea) — 0. (34) 


Differentiating both sides of equation (34) with respect to w, we obtain 


2wh' (w?) = ifp (iw)pCiw) — plin)p (i) (35) 
If iw, is not simple, then w, must satisfy 
Elp(d) + be 
that implies 
p (iwp) + b(—1 emit we = 0. 
Together with equation (10), we have 


T= (36) 


Thus, by (33), (35) and (36), we obtain 


Im(7) = Im{ _ pa) = Im{ = oi, 


p(iwp) 


_ ,P(iwn)p(iwre) — P wre)PCiwre) _ web (wR) 
2p(iw, )p(iw,) |p(twr.) |? 


Since 7? is real, i.e. Im(7) = 0, we have h'(z*) = h (w2) = 0. Therefore, 
we get a contradiction to the condition h (z%) 4 0. This proves the first 
conclusion in the lemma. Differentiating both sides of equation (10) with 
respect to 7, we obtain 


, 


p(rA)- bre—*7 vas — b\e~*" =0, 
dt 


which implies 


dX(rT) ON _ bA [p’ (Aje7A7 — br] d| —p' (A)p(A) — br] 


dr p (A)jeat —br |p’ (A) e7 — br |? |p’ (A)er7 — br|? 


It follows together with (35) that 
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Re{X[ ~ P'Q)p) ~ #7] } 
r=r} Ip ye’? — br/? 
iwp | + p (iwp)p(iwp) — P (iwn)p(iwe)| 
2\p' (iw, )eiweTr” = br) 2 
wah (wR) 


r br |2 


—,) 
rT 


Ip" (icy eine! 
= wah (zk) 40 
Ip (iergetenre” — bry? 


These Ow) 


By the well-known Routh-Hurwitz criteria, we can find the following set 
of conditions: 


__u) #0. This completes the proof. 
T=Ty, 


ay 100... 0 
a, l a3 a2 4,0... 0 
Hy =det (a1) >0, Ha=det ( ) $0, Hy =adet by os . | >0. 
a3 2 oper Mt, tips hoe 
Ce Oa 0 pete 


(37) 
To discuss the distribution of the roots of the exponential polynomial 
equation (8), we need the following result from Ruan and Wei [14]. 


Theorem 3.3. Consider the exponential polynomial 


pA, gore as etm) =)\r+ port... +p) A+p©) 


a 


+[pj rT tp)  A+pM]ePr 


[po ar-} bee + pl d + pl) e—rtm 


where 7, > 0 (i = 1,2,...,m), and pe (@@ = 0,1,2,...,m;7 = 1,2,...,n) 
are constants. As (71,72,...,T7m) vary, the sum of the orders of the zeros 
of p(A, eX, ...,€7°7™) on the open right half plane can change only if a zero 
appears on or crosses the imaginary axis. 


Now, we can state the following main theorem: 


Theorem 3.4. Suppose that conditions (1), (5) and h (zz) #0 hold, where 
h(z) is defined by (4) and zf =wz. Then, system (1) undergoes Hopf bifur- 
cation at the origin when T = S~_, 7; passes through tT, and it has a branch 
of periodic solutions bifurcating from the zero solution near T = 7, where T 


is defined by (31). 


Proof. By the well-known Routh-Hurwitz criteria, we can conclude that when 
(37) holds, all the roots of equation (8) at 7 = 0, have negative real parts. 
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Hence, by using theorem 3.3, we conclude that the zero solution of system 
(1) is asymptotically stable when t < 7. By using lemma 3.2, we can see 
that the conditions of Hopf bifurcation are satisfied at T = 7) in system (1), 
and so Hopf bifurcation occurs at the origin. In addition, a family of periodic 
solutions appear as 7 passes through 79. 


4 Numerical simulations 


In this section, numerical simulations are presented to support our theoretical 
results. We will study system (1) for the case n = 7. Consider the following 
system 


41 (t) = —221(t) + tanh(x1(t)) + 2tanh(a7(t — 77)), 

to(t) = —2x2(t) + tanh(x2(t)) + tanh(a1(t — 7)), 

43(t) = —2a3(t) + tanh(x3(t)) + 1.2tanh(xo(t — 72)), 

ta(t) = —2x4(t) + tanh(x4(t)) + tanh(a3(t — 73)), (38) 
&5(t) = —2a5(t) + tanh(x5(t)) — 0.5tanh(a4(t — 74)), 

&6(t) = —2x6(t) + tanh(xe(t)) + 0.5tanh(a5(t — 75)), 

&7(t) = —227(t) + tanh(x7(t)) + 2tanh(x6(t — 76)), 


which has the origin as an equilibrium point. By equations (8) and (9), we 
obtain the associated characteristic equation for n = 7: 


NETS LE DIAP A B5A* + BEAT HOD TE ade 4A" SO, (39) 


By the equations (30) and (31), we can compute 7) = 6.7067. Choosing 
T = 0.8, 72 = 1, 73 = 0.6, | = 1, % = 1.1, 7 = 0.7 and 7 = 1, Figure 
2 shows that the origin is asymptotically stable, and the phase portraits for 
system (38) are shown in Figure 4. When 7 = ae 7; passes through the 
critical value 7) = 6.7067, the origin loses its stability and Hopf bifurcation 
occurs, i.e., a family of periodic solutions bifurcate from the origin. Choosing 
TT = 0.9, 7] = 1, 73 = 0.8, | = 1, 75 = 1.3, 7 = 0.7 and 7 = 1.1, Hopf 
bifurcation happens at the zero solution. In Figure 3, the bifurcating periodic 
solutions are presented, and the phase portraits for system (38) are shown 
in Figure 5. Hopf bifurcation is supercritical and the bifurcating periodic 
solutions exist for T > 7. 
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Figure 2: The origin is asymptotically stable while 7; = 0.8, 72 = 1, 73 = 0.6, 
Tm = 1,75 = 1.1, 7% =0.7 andy =1 


5 Conclutions 


In this paper, we investigated the dynamics of a general class of ring networks 
with n neurons and n time delays. We have chosen T = 71+7)+...+7Tp as a bi- 
furcation parameter and analyzed the corresponding characteristic equation. 
Then we have proved that the zero solution (the equilibrium point of the 
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Figure 3: A family of periodic solutions bifurcates from the origin when 
T = 0.9, %] = 1, 73 = 0.8, 7 = 1, 7% = 1.3, 7 = 0.7 and 77 = 1.1 


system) loses its stability and Hopf bifurcation occurs. Therefore, a family 
of periodic solutions bifurcate from the zero solution when 7 passes through 
a critical value 7). Finally, the results have been validated by numerical 
simulations. 

At the end, we would like to point out that it is so significant to study 
the networks in general case, not for a special value of n. Although, in this 
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Figure 4: The phase portraits while 7, = 0.8, 72 = 1, 73 = 0.6, 7m = 1, 
T = 1.1, 7% =0.7 and 77 =1 


Figure 5: The phase portraits when 7, = 0.9, 72 = 1, 73 = 0.8, 7m = 1, 
Ts = 1.3, T = 0.7 and 77 = 1.1 


paper, we considered a general kind of ring networks, the methods, we have 
proposed can be generalized to be applied for other kinds of neural networks. 
We leave this as the future research. 
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